Integrating Stereo Vision with a CNN Tracker for a Person-Following Robot
نویسندگان
چکیده
In this paper, we introduce a stereo vision based CNN tracker for a person following robot. The tracker is able to track a person in real-time using an online convolutional neural network. Our approach enables the robot to follow a target under challenging situations such as occlusions, appearance changes, pose changes, crouching, illumination changes or people wearing the same clothes in different environments. The robot follows the target around corners even when it is momentarily unseen by estimating and replicating the local path of the target. We build an extensive dataset for person following robots under challenging situations. We evaluate the proposed system quantitatively by comparing our tracking approach with existing real-time tracking algorithms.
منابع مشابه
Parameters Identification of an Experimental Vision-based Target Tracker Robot Using Genetic Algorithm
In this paper, the uncertain dynamic parameters of an experimental target tracker robot are identified through the application of genetic algorithm. The considered serial robot is a two-degree-of-freedom dynamic system with two revolute joints in which damping coefficients and inertia terms are uncertain. First, dynamic equations governing the robot system are extracted and then, simulated nume...
متن کاملPerson following through appearance models and stereo vision using a mobile robot
Following a person is an important task for mobile service and domestic robots in applications in which human-robot interaction is a primary requirement. In this paper we present an approach that integrates appearance models and stereo vision for efficient people tracking in domestic environments. Stereo vision helps in obtaining a very good segmentation of the scene to detect a person during t...
متن کاملParticle Swarm Optimization Based Parameter Identification Applied to a Target Tracker Robot with Flexible Joint
This paper focuses on parameter identification of a target tracker robot possessing flexible joints using particle swarm optimization (PSO) algorithm. Since, belt and pulley mechanisms are known as flexible joints in robotic systems, their elastic behavior affecting a tracker robot is investigated in this work. First, dynamic equations governing the robot behavior are extracted taking into acco...
متن کاملActive stereo vision-based mobile robot navigation for person tracking
In this paper, we propose a mobile robot architecture for person tracking, consisting of an active stereo vision module (ASVM) and a navigation module (NM). The first tracks the person in stereo images and controls the pan/tilt unit to keep the target in the visual field. Its output, i.e. the 3D position of the person, is fed to the NM, which drives the robot towards the target while avoiding o...
متن کاملFusion of stereo and still monocular depth estimates in a self-supervised learning context
We study how autonomous robots can learn by themselves to improve their depth estimation capability. In particular, we investigate a self-supervised learning setup in which stereo vision depth estimates serve as targets for a convolutional neural network (CNN) that transforms a single still image to a dense depth map. After training, the stereo and mono estimates are fused with a novel fusion m...
متن کامل